Skip to content

Fix workspace-scoped Codex skill discovery#3059

Open
Quicksaver wants to merge 89 commits into
pingdotgg:mainfrom
Quicksaver:fix/codex-skills
Open

Fix workspace-scoped Codex skill discovery#3059
Quicksaver wants to merge 89 commits into
pingdotgg:mainfrom
Quicksaver:fix/codex-skills

Conversation

@Quicksaver

@Quicksaver Quicksaver commented Jun 12, 2026

Copy link
Copy Markdown

Summary

Fix Codex repo-local skill discovery by resolving skills for the active project or worktree cwd instead of relying on the provider-wide status snapshot.

The implementation adds a workspace-scoped provider-skills RPC and a shared web/mobile resolution policy so composer suggestions and rendered skill chips refresh for the correct workspace without leaking stale skills across workspace, environment, or provider changes.

What Changed

  • Add server.listProviderSkills contracts, WebSocket and local API handlers, and environment-query wiring keyed by environment, provider instance, and cwd.
  • Add ProviderSkillsLister to return snapshot skills for non-Codex or disabled Codex providers and run Codex skills/list in the validated workspace cwd for enabled Codex providers.
  • Prepare the configured Codex home and forward configured launch arguments before each probe, and return bounded structured errors for provider lookup, settings, cwd, home-preparation, timeout, and app-server failures.
  • Coalesce identical requests with a short TTL cache for successful lookups only, keep failed probes immediately retryable, bound cache capacity and concurrent probes, and terminate short-lived Codex app-server processes when requests finish or time out.
  • Run Codex provider status probes with the configured server cwd instead of the backend process cwd.
  • Share the workspace-skill state policy across web and mobile: preserve settled skills during a same-workspace refresh, clear them while switching targets or after a failed refresh, and fall back to provider snapshot skills after empty or failed lookups while keeping errors visible, without refreshing workspace probes when only client-side fallback skills change.
  • Align mobile workspace-skill lookup with environment connectivity and lazy activation: disconnected clients retain only verified same-workspace skills or provider fallback with a reconnect error, inactive same-workspace lookups preserve their verified snapshot, and pending workspace switches clear snapshots from other targets.
  • Load composer workspace skills only when needed for the $ menu or existing complete $skill references, and load timeline skills only when a sent user prompt contains a complete skill reference, including one at the end of the message; web and mobile new-worktree drafts deliberately use snapshot fallback until their cwd exists and never probe the base checkout for repo-local skills.
  • Reuse workspace-scoped skills for web and mobile composer suggestions, inline editor chips, pending answers, and submitted user-message skill chips, with shared token-boundary handling across web and mobile rendering.
  • Add focused coverage for RPC handling, workspace validation, Codex app-server cwd and lifecycle behavior, timeout and request coalescing, query-key isolation, stale-state prevention, lazy skill references, fallback/error rendering, search ranking, and timeline chips.

Why

Fixes #3040.

Codex discovers repo-local skills relative to the cwd supplied to skills/list, but a provider status snapshot is global to the provider instance. A workspace-scoped query is therefore required to show the correct skills for each project and worktree, especially while switching between workspaces or refreshing under failure.

Validation

  • pnpm exec vp test --maxWorkers=1 apps/server/src/provider/ProviderSkillsLister.test.ts apps/server/src/provider/Layers/CodexProvider.test.ts packages/client-runtime/src/state/providerWorkspaceSkills.test.ts packages/client-runtime/src/state/runtime.test.ts apps/web/src/lib/providerWorkspaceSkillsState.test.ts apps/web/src/composer-editor-mentions.test.ts apps/web/src/components/chat/ComposerCommandMenu.test.tsx apps/web/src/components/chat/MessagesTimeline.test.tsx apps/mobile/src/features/threads/new-task-provider-skills.test.ts apps/mobile/src/features/threads/thread-composer-skill-items.test.ts (10 files, 92 tests passed)
  • pnpm exec vp test --maxWorkers=1 apps/server/src/server.test.ts -t "server.listProviderSkills" (5 tests passed)
  • pnpm exec vp test run --passWithNoTests apps/mobile/src/lib/nativeMarkdownText.test.ts packages/shared/src/skillInlineTokens.test.ts (native and shared inline-token coverage passed as part of the focused 4-file run)
  • pnpm exec vp check apps/server/src/provider/Layers/CodexProvider.ts apps/server/src/provider/Layers/CodexProvider.test.ts apps/server/src/provider/ProviderSkillsLister.ts apps/server/scripts/codex-skills-mock-app-server.ts packages/client-runtime/src/state/providerWorkspaceSkills.ts packages/client-runtime/src/state/providerWorkspaceSkills.test.ts apps/web/src/lib/providerWorkspaceSkillsState.ts apps/web/src/lib/providerWorkspaceSkillsState.test.ts apps/mobile/src/state/providerWorkspaceSkillsState.ts (9 files passed formatting and lint/type-aware checks)
  • pnpm exec vp check (0 errors; 9 existing React warnings)
  • pnpm exec vp run typecheck (15 tasks passed)
  • pnpm exec vp run lint:mobile (passed; SwiftLint, ktlint, and detekt were unavailable)
  • Playwright smoke against web 5735 and server 13775: paired the isolated app, added the codex-skills worktree, and verified that typing $ opened the skill picker with repo-scoped entries such as iOS Debugger Agent alongside system skills.
  • pnpm exec vp test run --passWithNoTests --project unit src/components/ChatView.logic.test.ts src/components/chat/ComposerCommandMenu.test.tsx src/lib/providerWorkspaceSkillsState.test.ts from apps/web (3 files, 47 tests passed after the future-worktree review fix)
  • pnpm exec vp check src/components/ChatView.logic.ts src/components/ChatView.logic.test.ts src/components/ChatView.tsx src/components/chat/ChatComposer.tsx from apps/web (4 files passed formatting and lint/type-aware checks)
  • Playwright follow-up against web 5735 and server 13775: with $ open, a future-worktree draft sent 0 server.listProviderSkills frames; switching the same draft to the current checkout sent 1 request with the assigned worktree cwd.
  • pnpm exec vp test run --passWithNoTests src/state/providerWorkspaceSkills.test.ts from packages/client-runtime, the two focused mobile provider-skill tests, and the focused web workspace-skill state test (4 files, 42 tests passed after the mobile connection/state review fixes).
  • pnpm exec vp check apps/mobile/src/state/providerWorkspaceSkillsState.ts apps/mobile/src/features/threads/new-task-flow-provider.tsx apps/mobile/src/features/threads/ThreadDetailScreen.tsx packages/client-runtime/src/state/providerWorkspaceSkills.ts packages/client-runtime/src/state/providerWorkspaceSkills.test.ts (5 files passed formatting and lint/type-aware checks).
  • Integrated follow-up used isolated state on assigned web 5735 and server 13775; both browser automation profiles were locked by other sessions, and the available simulator lacked the required com.t3tools.t3code.dev client, so no new runtime assertion was recorded. All owned processes were stopped and isolated state was cleaned up.
  • pnpm exec vp test run --passWithNoTests src/provider/ProviderSkillsLister.test.ts from apps/server (1 file, 5 tests passed after making failed cache entries immediately retryable).
  • pnpm exec vp check src/provider/ProviderSkillsLister.ts src/provider/ProviderSkillsLister.test.ts from apps/server (2 files passed formatting and lint/type-aware checks).

Proof

  • No external proof artifacts; validation is covered by the automated checks above.

Note

Medium Risk
Touches provider probing, WebSocket RPC, and composer/timeline skill UX across server, web, and mobile; token boundary changes may alter which $ segments render as skills.

Overview
Fixes repo-local Codex skills in the $ picker and message chips by resolving skills for the active project/worktree cwd instead of the global provider snapshot.

Server: New server.listProviderSkills RPC (contracts, WS, client-runtime query keyed by environment + instance + cwd). ProviderSkillsLister runs Codex skills/list in the validated workspace cwd with coalescing, bounded concurrency, short TTL on success, 15s probe timeout, and sanitized structured errors; non-Codex/disabled Codex still return snapshot skills. Codex status probes use configured server cwd, not process.cwd().

Clients (web + mobile): Shared useProviderWorkspaceSkills / resolution policy—lazy probes only when the $ menu is open or a complete $skill token exists (timeline: sent user messages only); future-worktree drafts skip cwd until materialized. Preserves same-workspace skills while refreshing; clears on switch/failed refresh; falls back to snapshot on empty/error/disconnect with visible errors in skill menus.

Shared: @t3tools/shared/skillInlineTokens centralizes token parsing (punctuation boundaries; excludes $HOME-style continuations) for web chips, mobile markdown, and composer logic.

Reviewed by Cursor Bugbot for commit bb00f1d. Bugbot is set up for automated code reviews on this repo. Configure here.

Note

Fix workspace-scoped Codex skill discovery across web, mobile, and server

  • Adds a server.listProviderSkills WebSocket RPC that spawns the Codex app-server with a caller-supplied cwd and returns workspace-specific skills; unauthenticated accounts return an empty list.
  • Introduces useProviderWorkspaceSkills hooks (web and mobile) that query workspace skills when the prompt contains a $skill token or the skill menu is open, showing loading/error states and falling back to provider snapshot skills.
  • Adds parseInlineSkillTokens and hasInlineSkillToken to @t3tools/shared with stricter boundary rules (e.g. $HOME/.codex and PHP $value; are no longer matched), replacing local regex implementations across web, mobile, and markdown rendering.
  • Skill suggestions in the composer command menus (web ComposerCommandMenu, mobile ComposerCommandPopover) now display an error banner and suppress the empty-state placeholder when skill discovery fails.
  • Avoids probing the base checkout for future worktree drafts by returning null from resolveProviderSkillsCwd / resolveNewTaskProviderSkillsCwd in that case.
  • Risk: ChatComposer now requires two new required props (providerSkillsCwd, providerSkillsConnectionAvailable); existing TypeScript callers will fail to compile without them.

Macroscope summarized bb00f1d.

- Propagate cwd through provider status probes
- Add server RPC for workspace skill discovery
- Load workspace skills in the composer UI
- Clarify bogus skill as a durable discovery test fixture

- Stabilize composer fallback skill array identity
- Skip Codex skill spawning for disabled instances

- Move bogus skill fixture out of workspace discovery
- Refresh workspace skill cache on provider and connection changes

- Validate Codex skill cwd before spawning the app server

- Cover server.listProviderSkills RPC branches
- Track the active workspace key in provider skill state

- Reset pending skills when switching workspace targets
@coderabbitai

coderabbitai Bot commented Jun 12, 2026

Copy link
Copy Markdown

Important

Review skipped

Auto reviews are disabled on this repository. Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Repository UI

Review profile: CHILL

Plan: Pro Plus

Run ID: 0e3b49a4-265c-4365-a994-8c6e2d9040bc

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@github-actions github-actions Bot added vouch:unvouched PR author is not yet trusted in the VOUCHED list. size:L 100-499 changed lines (additions + deletions). labels Jun 12, 2026
Comment thread apps/web/src/lib/providerWorkspaceSkillsState.ts Outdated
Comment thread apps/web/src/components/chat/ChatComposer.tsx
Comment thread apps/server/src/ws.ts Outdated
@macroscopeapp

macroscopeapp Bot commented Jun 12, 2026

Copy link
Copy Markdown
Contributor

Approvability

Verdict: Needs human review

This PR introduces a new workspace-scoped skill discovery feature with significant new server infrastructure, contracts, and cross-platform state management. Additionally, an unresolved review comment identifies an inconsistent eager-loading behavior on mobile.

You can customize Macroscope's approvability policy. Learn more.

- Keep pending skill lookups scoped to the active workspace key
- Surface Codex skill-list timeout errors in the composer
- Add regression coverage for stale pending skills
@github-actions github-actions Bot added size:XL 500-999 changed lines (additions + deletions). and removed size:L 100-499 changed lines (additions + deletions). labels Jun 12, 2026
# Conflicts:
#	apps/server/src/provider/Layers/CursorProvider.ts
#	apps/web/src/components/chat/ChatComposer.tsx
@github-actions github-actions Bot added size:L 100-499 changed lines (additions + deletions). and removed size:XL 500-999 changed lines (additions + deletions). labels Jun 19, 2026
Quicksaver and others added 2 commits June 19, 2026 14:07
# Conflicts:
#	apps/web/src/environments/runtime/connection.test.ts
#	apps/web/src/environments/runtime/service.savedEnvironments.test.ts
#	apps/web/src/environments/runtime/service.threadSubscriptions.test.ts
#	apps/web/src/localApi.ts
#	packages/client-runtime/src/wsRpcClient.ts
Co-authored-by: codex <codex@users.noreply.github.com>
Comment thread apps/web/src/lib/providerWorkspaceSkillsState.ts
- Keep prior workspace skills visible while refreshes are pending
- Add tests for loaded, pending, workspace-switch, and empty states
- Preserve and clear cached workspace skills by query state

- Cover pending data, empty data, and workspace switches
@github-actions github-actions Bot added size:XL 500-999 changed lines (additions + deletions). and removed size:L 100-499 changed lines (additions + deletions). labels Jun 19, 2026
Comment thread apps/server/src/provider/Layers/CodexProvider.ts
Comment thread packages/client-runtime/src/state/providerWorkspaceSkills.ts
@jakeleventhal

Copy link
Copy Markdown
Contributor

My PR #3982 solves for both codex and Grok

- Forward configured launch arguments to workspace skill probes
- Clear retained workspace skills after failed refreshes
- Add focused probe and snapshot regressions
@Quicksaver

Copy link
Copy Markdown
Author

@jakeleventhal Thanks for the pointer. I confirmed #3982 carries the provider-neutral Codex/Grok approach and explicitly supersedes #3901. This branch still includes additional mobile composer/feed coverage, timeline skill decoration, shared web/mobile refresh/error policy, and bounded structured failure handling, so I’ll leave the overlap visible for maintainers to decide what to merge or port.

Comment thread packages/client-runtime/src/state/providerWorkspaceSkills.ts
Comment thread apps/web/src/components/ChatView.tsx
- Pass a null skill cwd until a draft worktree materializes
- Keep local checkout skill queries and path searches unchanged
- Cover local, materialized, and future worktree resolution
# Conflicts:
#	apps/server/src/provider/Layers/CodexProvider.test.ts
- Keep matching workspace snapshots even when they contain no skills
- Cover empty disconnected snapshots with a regression test
- Keep snapshots keyed while lazy skill menus close
- Clear retained data when the workspace target changes
# Conflicts:
#	apps/web/src/components/ChatView.logic.test.ts
#	apps/web/src/components/ChatView.tsx
#	apps/web/src/components/chat/MessagesTimeline.test.tsx
# Conflicts:
#	apps/web/src/components/chat/ComposerCommandMenu.tsx
Comment thread apps/mobile/src/state/providerWorkspaceSkillsState.ts
Comment thread apps/mobile/src/state/providerWorkspaceSkillsState.ts Outdated
Comment thread packages/client-runtime/src/state/providerWorkspaceSkills.ts Outdated
- Follow mobile environment connectivity and lazy lookup state
- Clear retained skill snapshots across workspace switches
Comment thread BRANCH_DETAILS.md
Comment thread apps/server/src/provider/ProviderSkillsLister.ts
- Cache successful workspace skill probes for the configured TTL
- Expire failed probes immediately and cover retry behavior
- Document the success-only cache policy in branch details

@cursor cursor Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes using high effort and found 1 potential issue.

Fix All in Cursor

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit bb00f1d. Configure here.

enabled: true,
connectionAvailable: props.connectionStateLabel === "connected",
fallbackSkills: selectedProviderFallbackSkills,
});

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Mobile thread eagerly probes skills

Medium Severity

Mobile thread detail always sets enabled: true for useProviderWorkspaceSkills, so every connected thread open starts a workspace skills RPC and can spawn a Codex app-server probe even with an empty composer and no $skill references. Web and mobile new-task gate this behind the $ menu or a complete skill token, and the branch notes also describe lazy lookup with close/reopen retention, which this path never exercises.

Additional Locations (2)
Fix in Cursor Fix in Web

Reviewed by Cursor Bugbot for commit bb00f1d. Configure here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size:XXL 1,000+ changed lines (additions + deletions). vouch:unvouched PR author is not yet trusted in the VOUCHED list.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug]: Repo-local Codex skills do not appear in T3 Code $ skill picker

3 participants